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T¥0 forms of the Minnesota Importance Questionnaire 
(MIQ) , the multiple rank order form and the paired comparison form, 
were' compared in teras of psychometric characteristics and user • 
reactions. The MIQ forms were randomly administered to 290 subjects 
,on two different occasions resulting in a complete crossing of 
order-by-'f orm. The result's of ^alysis of variance of absolute 
differences b^etween first and second administration scores for the 
order-by-form groups, correlafted t-tests between first and second 
adminis'tration within groups, and the analysis of scale score 
^stability and profile stability within and between groups, 
^demonstrate that the level of scores and shape of the score profiled 
for the* ranked form are similar to those of the paired form. 
Sub jects"K reactions to the two MIQ forfiis were ^ound to differ, with 
two-thirdi^ of the subjects preferring the, ranked form. Further 
^research exploring the comparability of the ranked form and pa'ired 
form is proposed. (Author) 
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A Comparison of Multiple Rank Order and Paired Comparison Forms 
^ * of the Minnesota Importance Questionnaire! 

( James B. Rounds, Jt. , and Rene V. Dawls 

Fisher, Weiss, and Dawls (1968), In an Investigation of the comparability of 
the Llkert and paired comparison techniques of scaling multivariate attitudes, 
noted the lack of research compar'ing different scaling methods. Of the available 
studies. Investigators have primarlljr studied the psychometric comparability of 
various scaling methods (for a review of the research see Fisher et. al . , 1968). 
However, investigators havff^not systematically studied the preferences and sub- 
jective reactions of test users to the different scaling formats. Although 
psychometric characteristics and relationships between scale scor.es scaled by 
different techniques are necessary in comparability studies, they are not suf- 
ficient to gain acceptance within the test consumer community for the various 
methods of scaling and concomitant instrumentation. Users of tests are concerned 
with the subjective reactions of their clientele to different methods of scaling. 

The Work Adjustment Project has investigated several different techniques 
of scaling vocational needs: dichotomous summatlve scaling, multipoint summ^tive 
scaling (Llkert), and paired comparison scaling. (Gay. Weiss, Hendel , Dawis , and 
Lofquist. 1971). Of the three techniques , the pairfid comparison method was 
chosen as the technique for scaling vocational needs. Several studies (Weiss. 
Dawls, England, and Lofquist, 1964; Fisher et al. , 1968) have demonstrated that 
paired comparison scaling was an Improvement over the other two techniques 
because paired comparison scaling resulted in lov7er scale intercorrelations and 
Increased variability of the scale scores with no lOps in the Internal consis- 
tency of the scales. The research on scaling and vocational needs resulted in 
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the current 1967 revision of the Minnesota Importance Questionnaire (MIQ) , which 
haa two aectlo^--a paired comparison section of 190 items and an absolute 
f • judgment section of 20 items. 

Several charactferletics of the MIQ paired comparison format have resulted 
in complaints from test users. Although no pair of need statements is repeated 
among the 190 pairs, users have complained about the repetitlveness of the 
pairings. Since many users feel the paired ^comparison section is repetitive and 
laborious, the time involved in the task is a focus of complaints. Finally, the 
forced choice characteristics of paired comparison scaling results in criticism. 
Some users feel "trapped" by an either-or choice between two alternatives that 
may be- equally attractive or unattractive. 

To answer theoe criticisms the Work Adjustment Project has developed a 
ranked form of the MIQ. The' technique used' to scale tlje 20 vocational needs is 
- known either as the method of multiple rank orders or balanced incomplete blocks 
(Gullikoen and Tucker, 196.1; Gullikaen, 1964). The method of multiple rank 
orders provides all the essential information supplied by the kethodp of paired 
comparison. The ranked method aig used with the MIQ presents vocational need 
statements in blockp of five statements which are to be ranked within bloclce, 
whereas the paired method presents the vocational need statements in pairs. 
Implicit in the ranking of five vocational neu^ statements are ten paired coEpari- 
aono. Th4refore, the ranked responses can be converted to paired comparison 
reeponaea. Thus, the ranked method reduces the number of Judgments required, 
tliereby reducing the length of the instrument and consequent administration time. 
The reduction in time achieved by this method. In contrast to the paired compari- 
son method, is appcrent when one compares . the 105 responses required by the 
ranked method with the 190 responses required by paired comparison. In addition, 
the multiple rank order method produces a shorter MIQ. The ranked format requires 
105 lines to present the need statements to b6 ranked while the paired comparison 
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fornyit requires 380 lines lla the current IIIQ. Finally, the objection to the 
forced choice characteristic of the paired comparison method Is alleviated through 
the process of ranking the vocational need statements. 

The purpose &£ this study Is to investigate the comparability qf the MIQ' 
multiple rank order form with the MIQ paired comparison form In terms of both 
psychometric characteristics and user reactions. Two questions were Investigated: 
a) Do the multiple rank order scale scores differ from paired comparison scale 
scores?; and b) What forT9 do users prefer and why?' 

' Method 

Subjects . The subjects In this study were 290 undergraduates at the 

^University of Minnesota enrolled In an Introductory psychplogy course. All sub- 

\ ' ■ ■ 

Jects received points toward their final course grade for participating In the 
s tudy . 

Instruments , The Instruments used were two forms of the Minnesota Importance 
Questionnaire (MIQ). One form employs the multiple rank orders method (ranked 
form) and the other form employs the method of paired comparison (paired form) 
In scaling the same 20 dlmetxslons. 

The paired form Is the 1967 revision of the MIQ designed to measure 20 / 
vocational need dimensions. This form consists of a comparative Judgment section. 
In which each of the vocational need statements Is paired with every other • ^ 
statement yielding 190 pairs, and an absolute Judgment section composed of«the 
20 vocational need statements. In the comparative Judgment section the'subjecta 
choose the statement of each pair which represents the more Important character- 
Istlc of their Ideal Job. In the absolute Judgment the subjects Indicate 
whether or i\ot each of the 20 nee^ dimensions. is Important or not Important In 
their Ideal Job. 

The ranked form consists or a comparative Judgment section, with 21 blocks 
of five vocational need statements each, and an absolute Judgment section 
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identical to the «»b8t^ute Judgment section of the paired form. In the multiple 
rank, order method, only certain numbers of sta'tements can be ranked in blocks 
of a given size and result in complete paired comparleon data. For blocks of 
5 statenents, 21 stateinents are required. Therefore, a 21st statement was added 
to the 20 statements In the comparative judgment section. The 21st statement, 
representing the dlmenalon of autonomy, was "I could plan ray work with lit t la 
supervision." For purposes of comparability bj&tween MIQ forms, the autonomy 
nead dimension Is not scored • In the comparative Judffment section subjects rank 
the need statements with respect to their relative Imj^ortance In thBlr Ideal 

job. . - ^ — . 

An Important InHex on the MIQ la the total circular triad (TCT) score. The 
maximum nuiAer of TCTs foj the paired fOrn Is 385. While theoretically, the 
rr^M^ Axmxm nUxober of trlads for the ranked fqrm Is 385, a number of these triads 
are within the ranking blocks and therefore cannot be made circular. Thua, the 
distribution of TCTs for random tespondlng differs between the forms. The 

distribution for the paired form has a mean of 333 and standard deviation of 

^ ^■ 
15.6 whereas for the ranked form It has; a mean of 280 and standayd deviation of 

29. Consequently, 'TCT scores of 254 and 193 were' chosen as the maxl m i nn allow- 
able for a valid profile for the paired and ranked forms, respectively. 

Procedure . The MIQ forms were adntlnlBtared to the 290 subjects on two dif- 
ferent occasions. Th^ time between testing was A8 hpurs. At the first testing 
(Time 1) suS^ects were randomly Administered either the paired or the ranked 
form^ At the second testing (Time 2) subjects were again randomliy given either ' 
the paired or the ranked form. This experimental design (see Figure 1) resulted 
in a cojqjlete crossing of the order in which the instruments wore ad.iilnlstered 
to the subjects. 



Insert Figure 1 about here 



The order-by-form design resulted in four groups: Time 1 paired form and 

erJc g 



\ 



Time 2 paired form (group PP: N » 73);, lime 1 paired form and Time 2 ranked form 
(group PR; N • 67); Time 1 ranke<J form and Time 2 paired form (group RP; 73) 
and Time 1 ranked form and Time 2 paired form (groUp RR; N - 77). After the 

A 

second testing* subjects in groups PR and RP were^ asked to indicate which form 
they preferred and why they preferred that form. All subjects were also 
requested to Indicate on their booklets the time they began and t^ie time they 
cotapleted their questionnaires. 

Analysis . Fout different statistical analyses were carried out to investi- 
gate the accuracy with which the multiple rank order method scales the 20 need 
dimensions. Tbe criterion utilized to assess accuracy was the paired comparison 
method of scaling the same 20 need dimensions. The four analyses explored both 
group and individual diffeifences in scale scores jresulting from the two methods*" 

The following analyses were conducted: a) ^between-group coiftparison of the 
absolute dif f qrence between Time 1 and Time 2 scores for each of the 20 need 
dimensions; b) wi thin-group comparison of Time 1 and Time Z mean scale scores 
for each need dimension; c) within-group determination of individual scale score 
stability between Time 1 and Time 2; and d) v/ithin-group determination of the 
stability of score profiles between Time 1 and Time In the first analysis, 
groups were compared by performing a one way analysis of variance. The 
dependent variable was the absolute difference between a Time 1 score from a 
Time 2 score on the same scale. In the second analysis correlated t-tests were 
used to compare mean scale scores for Time 1 and Time 2, for each scale and for 
each group separately. In the third analysis » s<:ale score stability was Investi- 
gated by studying shifts in an individual's scale score hcross the 20 need 
dimensions. A shift was defined as a change from a Time 1 scale score to a 
Time 2 scale score across Mo points: 0 and 1.0. These points divide the s£:ale 
into ranges corresponding to low or no importance (lower than 0.0), some importance 

(between 0.0 and 1.0) and high importance (higher than 1,0). A shift, then, v/ould 
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be a change from one range to another. Scale score stability was investigated 
fot each of the four groups separately. In^the fourth analysis an individual's 
20 scale scores at Time 1 were correlated with the same individual's 20 scale 
scores at Tine 2. Again, this was done for each group separately. 

Three different tabulations were made to determine which scaling format the 
subjects preferred, reasons for their preference, and amount of time needed to 
complete the two scaling format. (This analysis was done only for those sub- 
Ject^ who took both forms of the MIQ.) In the first tabulation a 2 x 2 table 
cross -classifying order of administration by form preference was submitted to 
a chi-square test to evaluate the effects of order of administration. The 
second tabulation listed the results of a content analysis categorizing the 
reasons for the preference. In tlie final tabulation the average time required 
to complete the paired and ranked forms was calculated. 

Results 

Comparison of Scale Scores 

Absolute differences . Table 1 presents the results of the analysis of 
variance for the absolute differences between Time 1 and Time 2 scores for each 
of the 20 needc^scales. 



Insert Table 1 about here 



Five of the'twenty F ratios were statistically significant at the .01 level and 
one at the .05 level. As shown in Table 2, the Student Newman-Keuls test of 
©eon absolute differences was used to identify significant mean differences 
betr^een any groups. The group differences of concern to this study, pertaining 
to the comparability of the paired and ranked forms, are, those between the 
groups labeled PP, PR, and RP. 
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Insert Table 2 about here 

Results of the analysis for fthe six scales of Activity, Advancement, Authority, 
Moral Values, Social Service, and Social Status showed statistically significant 
mean differences (p<.05) with the RP group differing from the PR and PP groups. . 
It should be noted, however, that the values for these mean absolute differences 
were relatively small, ranging from .10 to .23. All five of these statistically 
significant mean differences were in the same direction and order, with the RP 
group differing from the PP and PR groups and the RP group producing the largest 
mean absolute difference. Across the 20 scales the mean absolute differences for 

the PP, PR, and RR groups, taken pairwiae, did not differ statistically. The 

/ 

statistically significant mean differences between the RP group and the PR 
group may be due to an order affect of administration, that is, which form was 
administered first. 

Mean scale score differences . To determine the extent of scale score dif- 
ferences between administration times, correlated t tests were computed between 
Time 1 and Time 2 scale score means for each group. Table 3 through Table 6 
show the scale means, standard deviations and correlated t tests, for each scale 
and each of the four groups. The paired form test-reteat mean differences 
(Table 3) and the ranked form test-reteat mean differences (Table 4) are very 
similar in the direction, level, and pattern of differences across the 20 scales. 
Only three mean differences are statistically significant for the paired test- 
retest group and four mean differences are statistically significant for the 
ranked teat-re test group. 

Insert Tables 3 and k about here /^^^^[^ 

These test-retest mean differences for the paired and ranked forms serve as a 
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baseline by which to evaluate the comparability of the ranked and paired. forms 
In the PR and RP groups, where order and form ar^ alternated. 

Examination pf the level and ^pattern of the s^al^ score means and standard 
deviations presented in Table5show,s few differences between the paired form 
given first (Time 1) and the ranked form given second (Time 2), with only five 
mean differences being statistically significant. 



Insert Table 5 about here 



^Although the direction o^ mean differences for the PR group in comparison to the 
PP group and RR group are opposite in direction, the mean differences are alqiost 
identical in pattern and absolute level. 

Changing the order of administration, with the ranked form first and paired 
form second, results in frequent and large differences 4n leyel and pattern of 
mean scale scores and stafidard deviations, as shown In TabJLe 6. Ten of the mean 
differences are statiatically significant . \ 

^ \ 

Insert Table 6 about here ^ ^ 

The directional pattern of the mean differences does not replicate the results 
obtained with the paired form first and racked form second; rather, it confirms 
the observation that the comparability of the ranked form with the paired font Is 
confounded by the drder in which the forms were iidmlniatered* Although these 
results differ considerably from the baselihe PP and RR groups, the. mea^ differ- 
ences are still small in terms of the scale score rcmge of eight acale^nits. 

Scale score etabllity . To determine whether scale score dlf f er^nce^^^om 

/ 

Time 1 to Time 2 would result in a dif ferent interpretation of the/ individual 

' . . \ . - / 

roinforcer preferences, scale scor«i aliifta were tabulated separately for the 

I / 
four groups in a 3 x 3 'table, as shown in Table 7. / 
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Insert Table 7 about here 

For each group, scale score stability la indicated by the diagonal cells ninning 
from the upper left comet to the lower right comer In the table. Inspection 
of Table 7 shows very similar^cale score stability across all four groups. The 
sum of the diagonar percentages is: for group PP, 77 • 7%; for group RR, 78. 4Z; 
for group PR, 72. 5Z; and for group RP, 70. 2Z. These results demonstrate that 
the use of tha ranked form in comparison to the pained form results in similar 
interpretations of reinforcer preferences. 

Profile stability . The range and median vlflues of profile stability ^ 
coefficients for the four groups are, shown in Table 8. 

Insert Table 8 about here 

The median stability coefficients are; .92 for the PP group; .91 for the PR 
group; .86 for the RP group; and .92 for the RR group. The lowest profile 
stability coefficient- was zero for the PP group, and the highest coefficient was 
.99, for both the PP and RR groups. These results show that the ranked form 
profiles are as stable qs the paired form profiles over a 48 hour test-retest* 
interval. Also, these results indicate that the sha'pf of an individual's pro- 
file 'is the same whether scaled by the paired comparison method or the multiple 
" rank order method. 
Other Findings Concerning the Scaling Format 

Table 9 shows the chi-aquare analyses of the ci^as-classlf ication order of 
administration by the form preference. 

Insert Table 9 about here 

Regardless of order of administration, more subjects pref erred the ranked form 
over the paired form. However, proportionately more subjects preferred the 
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paired 'form when it was administered second than preferred It when It was admin- 
istered first. 'Although there was an ordter effect (X2 - 9.41, p4.005), two- 
thirds of the" subjects preferred the ranked form. 

Table 10 presents a content analysis of the reasons given for the subject's 
preference for either the multiply rank order or paired comparison form. 



Insert Table 10 about here 



The 67%. who preferred the ranked' form were about evenly divided in the reasons 
they gave for their preference.^ Of this group approximately 57% stated that the 

ranked format of ranklhg five need statemeiits was more acceptable than the forced 

* . ■* . 

choice format of the paired form. The other 43% chose the ranked form because 
they found the paired form repetitive and boring. The 33% who prelerred the 



paired form found the fSBrced choice^f ormat to thiiir liking, stating that it was 
easier to judge between two need statements than to rank five need statements* 

Table 11 presents the means , standard deviations,^ and range of the time 
required to complete the two forms. 



Insert Table 11 about here 



The completion times were computed only for Time 1 by combining 'the PP and PR 
groups for the paired form completion time and the RR and RP groups for the 
ranked form completioti time. Subjects completed the ranked form in approximately 
one-half the time required to complete the paired form. Since the range of 
completion times overlapped for the paii^ed and. ranked forms, some subjects 
completed the paired form in les^^time than some subjects needed to completip the 
rank form. The mean completion times for the ranked form was 165a minutes, and 
for the paired form^ 28 minutes. 



12 



ERIC 



-11- ' . 

Summary and Conclusions 
The multiple rank order form of the MIQ was compared with the i^alred com- 
parlson form of the MIQ In terms of the psychome.tric characteristics of score 
level and profile shape and In terms of subject preference for scaling format. 
To test the hypothesis that the levels of scale scores generated by tl^ two forms 
are similar, sriS: analysis of variance was performed on the absolute differences 
betweeji Time 1 and Time 2 scores, with Student Newman-Keuls tests of pair-wise 
grou^ mean, differences and correlated t^ tests of mean differences between Time 1 
and Time 2 scale score means for each group. Since multiple F ^d t^ tests were 
run, a ba^e rate Indicating the nuinber of statistically significant* differences 
(SSDs) to expect by chance and test-retest was established from^the nximber of 
SSDs found/in the correlated Jt t^sts of mean differences for the paired form 
(Time 1 ys. Time 2) and the ranlb^ed; form (Time 1 vs. Time 2). These multiple 
t^ test J resulted in three and foiit SSDs for the paired, and ranked foirmis, 
re^pecti-^y. Using four SSDp as the base, rate, the results of the analysis 
of variance (shaWfng six SSDs) and correlated ^ tests for paired form (Time 1) , 
ranked form (Time 2), of five SSDs, and for raided form (Time 1), paired form 
(Time 2), of ten SSDs, were taken as supporting the comparability of forms. 
Although SSDs were ^fqund above, the base rate level, it was found that these 
score differences would not affect subsequent interpretations of individual 
reinforcer preferences. The results of the scale score stability analysis 
support this conclusion, with 72.5% of the scale scores stable across time for 
^roup PR and 70.2% for group HP in comparison with 77.7% for group PP and 78.4% 
fqr group RR. To test the hypothesis that the ranked and paired methods of 
scaling result in similar shape of score profiles, subjects' scale scores were 
correlated across administrations. Median profile stability coefficients *for 
the PR group and RP group (.92 and .86, respectively) indicate that the ranked 
and paired profiles are similar. To test the hypothesis that subjects prefer 
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the ranked scaling fomuat, subjects In thp PR and RP groups were asked to Indl- 
cate their preferences. The" results showed that -67% of the subjects predEerred' 
the ranked 'scaling format* 

Additional results of this study suggest the following cfincj-uslons: 
(a) The ranked form profiles are as stable as the .paired form profiles ov^^ " 
48 hour test-retest interval; (b) The ranked form completion time is one-half 
the completion time for the paired form; (c) Subjects preferred the ranked form 
for two reasons: . the ranke^ format allowed them to express their degree of ^ 
preference"; and the paired format was repetitive and boring; and (d) In the *; 
analysis of psychometric comparability and subject preference, an order-by-form 
effect was observe 

This order-by-form effect ^could be due to the testing c6n|^. Several ^ 
factors of the testing context could have c^tributed to the feffect. First, some 




subjelSS may have been relatively uxunotlvated* to respond memingfully to the 
MIQ forms because of the large group ;tesl: settina^'^Mtlie nature of the in- 
centive for participation, i.e., experimen^CL points. For these subjects, the „ 
real reward for participation might have been the speedy completion of testing. 
Second, ^ince subjects' testing time varied with MIQ form, those receiving the 
ranked' form left the testing session early while other subjects receiving the 
paired form had to plod on. Third, completing different forms at Time 1 may have 
set different expectations for Time 2. Subsequent ptudies should consider these 
factors as potentially contaminating. How this order-by-form effect confuses 
the results can only be investigated through a replication of the study. 

In summary, there is a strong similarity between the paired comparison 
method, and multiple rank order method of scaling and, not surprisingly, between 
the corresponding paired afi* ranked forms of the MIQ* The finding of compara-, . 
bility in level of scale score and shape of profile between the two forms of the 
MIQ is a strong but liot necessarily a sufficient condition to consider the 
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, / kankBd form' as an alternative form to the paired form. Further research is 
needed to investigate the effect of the multiple rank order 'method of scaling 
^ ox^ the total circular triad, and stimulus circular triad scores, and on the 
^ , internal consistency and factor structure of measured jlocational needs. 

I >, 
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SECOND 
ADMINISTRATION 

(Time 1) 





Paired 
Comparison 


Multiple 
Rank Order 




Groutp PP 


Group PR 


Paired 






' Comparison 


N - 73 


N - 67 ^^^ 


FIRST 
ADMINISTRATION 

(Time 1) Multiple 
Rank Order 


Group RP 
N - 73 


) Group RR 
' » - 77 



Flfure 1. Experimental design (Abbreviatlond: P ■ Paired 
Comparison Form and R ■ Hult;Lple Rank Order Form 
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Table 1 



Analysis of Variance of Absolute Differences Between 
Time 1 .and Time 2 Scores for Four Groups » by Scale 



Souf ce 


SS MS F 


p 


Source 


SS MS 


F 


p 


Ability Utilization 


\ 

i 


Moral Values 






Between 

Wfithin 

total 


.084 .028 .291 
27.418 .096 
27.502 ■ 


.832 


Between 

Within 

Total 


2.521 - .840 
62.284 .218 
64.805 


3.858 


.010 


Achievement 


Recognition ^ 


Between 

Within 

Total 


.450 .150 1.505 
28.519 .100 
28'. 969 


.214 


Between 

Within 

Total 


.358 .119 
31.347 .110 
31.705 


1.089 


.354 


Activity 




Responsibility 






4 

Between 

Within 

Total 


2.455 .818 7.174 
32.622 .114 
35.077 


<.001 


Between 

Within 

Total 


.605 .202 
29.-191 .102 
29.796 


1.977 


.118 


k 

Advancement 


Security 


Between 

Within 

Total 


1.705 .568 5.677 
28.633 .100 
30.338 


.001 


Between 

Within 

Total 


.751 .250 
28.569 .100 
29.319' 


2.50^ 


.059 


Au4:hority 


Social Service 


Between 

Within 

Total 


1.166 .389 3.123 
35.578 .124 
36.743 

s 


.026 


Between 

Within 

Total 


1.475 .492 
32°. 731 .114 
34.206 


4.297 


.006 

« 



-continued on the next page- 
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Table 1 


[cont. ) 






SourcG 


SS MS • P 




Source 




V 


Company Policies/Practices 




Social Status 




Betwaen 
Within 
Totial , 


.504 .168 2.177 
22.683 .079 
23.187 


.098 


Between 

Within 

Total 


1.641 .547 4.574 
34.203 .120 
35.844 


.004 




Compensation 




"ISuperviaion-Human Relations^ 


Between 

Within 

Tbtal 


.593 .198 2.430 
23.274 .081 
23.867 

• 


.065 


Between 

Within 

Total 


.367 .122 1.388 
25.223 .088 
25-. 590 


.247 


# 


Co-workers 




Supervision-Technical 


Between 

Within 

Total 


.398 ,.133 1.712 
22:188 .078 
22.587 


.165 


Between 

Within 

Total 


. .226 .075 .891 
24.204 . .085 
24.430^ 


.446 


Creativity 


# 

Variety 

> 


Between 

Within 

Total 


.502 .167 2.053 
23.310 .082 
23.812 


.107 


BetwoeA 

Within 

Total 


.311 .104 1.125 
26.315 .092 
26.626 


.339 


Independence 




Working Conditions 




Batwoen 

Within 

Total 


.613 .204 1.035 
56.429 .197 
57.042 


.377 


Between 

Within 

Total 


.447 .150 1.644 
25.935 .091 
26.382 


.1^9 



Note* df " 3, 286. 
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Table 2 



Newman -Keu Is Test of Mean Absolute 
Difference Between Any Two Groups, by Scale 



Rank 



ocaie 


1 

X 


2 


3 <\- 


4 






Mean Absolute Difference 




Ability Utilization 


.340 (PP) 


.346(RR) 


.37 6 (PR) 


.377(RP) 


Achievement 


.312 (PP) 


.357 (RR) 


.404(RP) 


.410 (PR) 


Activity 


.325(RR) 


.332JPP) . 


.439 (TO) 


,548(RP) 


Advancement 


.269(RR) 


.351 (PR) 


.364(PP) 


4481(RP) 


Authority 


.308 (PP) 


.410 (RR) 


.431 (PR) 


.482 (Rr) 


Company Policies/ 


.310(RR) 


= .341 (PP) 


.404 (RP) 


.408 (PR) 


Compensation 


.316(PP) 


.327 (RR) 


Otto /nisN r > 

•33o(rK; V , 


.432(RP) 


Co-workers 


.290(RR) 




363 (PR) 


.388(RP) 


Creativity 




,323(PP) 




.408 (R?) 


Independence 
norsi vaxue* 


.402 (PR) 


.421 (PP) 


.421 (RR) 


.519 (RP) 


400 rPP^ 


.416(RR) 


.515 (PR) 


. 632 (RP) 


Recognition 


.355(PP) 


.368 (RR) 


.378 (PR) 


.^45 (RP) 
.422 CRP) 


Responsibility 


»308(PP) 


.327(RR) 


.387 (PR) 


Security 
Social Service 


.317 (RR) 


.359(PP) 


.410(RP) 


.451 (PR) 


.323(RR) 


.369(PP) 


.431 (PR) 


.511 (RP) 


Social Status 


.340(PP) 


.388(RR) 


.421 (PR) 


.543 (RP) 


Supervision-Human 
Relations 


.336(RR) 


.344(PP) 


.396(RP) 


.422 (PR) 


Supervls ion -Technics 1 


.292(RR) 


.343(RP) 


.348(PP) 


.367 (PR) 


Variety 


.330(RR) 


.381 (PR) 


.406(PP) 


.411 (RP) 


Working Conditions 


.322 (RR) 


.337 (PP) 


.406 (RP) 


.409 (PR) 








♦ 



Note. Differences between unHerllned mean absolute differences are not 
statistically significant at e<.05. Abbreviations: " P - paired comparison 
and K ■ multiple rank order • 



Table 3 

, Time 1. and Time 2 Score Means and Standard 
Deviations for the Paired Comparison Form, by Scale 

^ Lj ' '- ■ 



Mean 



Standard Deviation 



Scale 


Time 1 


Time 2 


Difference 


t« 


Time 1 


Time 2 


Difference 


AU 


1.47 


1.46 


.01 


.11 


.59 


.57 


.44 


Ach 


1.51 * 


i.48 


.03 


.65^ 


i56 


.54 


.39 


Act 


-.11 


-.15 


.04 


.69 \ 


.78 


.87 


.46 


Adv 


.99 


1.04 


-.05 


.95 


.83 


.90 


.45 


Au 


-.44 


-.42 


-.02 


.42 


.85 


.97 


.39 


CPP 


.89 


.94 


-.05 


198 


.68 


.79 


.43 


Com 


.41 


.•52 


-.11 


2.32* 


.81 


.88 


.40 


Cow 




72 


- 06 


1.07 


.73 


.69 


.43 




1 07 


1 16 


- 09 


1.82 


.77 


. 78 


.44 


Tnd 




- 12 


- 03 


40 


.75 


.81 


.55 


HV 


1.48 


' 1.64 


- 16 

.XV 


2 . 69** 


1.11 


1.15 


.50 




82 


83 


- 01 

. w X 


.28 


.68 


.82 


.46 


Res 


.97 


1 ' f\f\ 

1.00 


r . OJ 


.DO 


. /I 


. / / 




Sec 


.72 


.84 


-.12 


2.20* 


.83 


■ .94 


.46 


SSe 


.97 


1.05 


-.08 


1.44 


.93 


.92 


.47 


SSt 


-.18 


-.21 


.03 


.50 


1.01 


1.09 


.44 


SHR 


.37 


.42 


-.05 


.99 


.76 


.78 


.41 


ST 


.27 


.36 


-.09 


•1°66 • 


.67 


.73 


-.45 


Var 


.29 ' 


.19 


.10 


1.58 


.78 


.81 


.50 


wc 


.68 


.72 


-.04 


.94 


.61 


.80 


.45 



■correlated t teat, df - 72, 

*E<.05. 
**g<.01. 
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Table 4 

Time 1 and Time 2 Score Means and Standard 
Deviations for the Multiple Rank Order Form, by Scale 



Scale Time 1 



Mean 



Time 2 Difference 



Stlndard Deviation 



^ Time 1 Time 2 Difference 



AU 


1.81 


1.86 


-.05 


.9tl 


.60 


Ach 


1.79 


^.72 


.07 


1.52 




Act 


.02 


.02 


.00 . 


.00 


.87 


Adv 


.94 


.95 


-.01 


.34 


.74 


Au 


-.50 


-.49 


-.01 


.26 


.80 


CPP 


.46 


.50 


-.04 


.84 


.68 


Com 


.39 


.49 


-.10 


2.37* 


.74 


Cow 


.77 


.79 


-.02 


.41 


.68 


Cre 


1.21 


1.23 


-'.02 


.47 


'.6ff 


Ind 


-fOB 


-.13 


.05 


.70 


.93 


MV 


.93 


1.14 


-.21 


3.30** 


1.06 


Rec 


• / J 


. o / 


-.14 


2.67* 


.86 


Res 


1.16 


1.19 


-.03 


.58 


.75 


Sec 


.65 


79 


-.07 


1.36, 


.83 


SSe 


1.19 


1.25 


.06 


1.10 


.91 


SSt 


-.17 


-.23 


.06 


.98 


1.13 


SHR 


.23 


.31 


-.08 


1.67 




ST 


-.01 


.10 


-.11 


2.54* 


.63 


Var 


.66 


\ 62 


.04 


.78 


- . .87 


WC 


.78 


.81 


-.03 


.55 


.70 


Note. 


N - 77. 






• 


t 

If 



•correlated t-teet, df 
*B<.05. 
**g<.01. 



- 76. 



.58 
.62 
.89 
.73 

,•85 
.65 
.72 
.65 
,66 
.93 
1.17' 
.90 
.75 
.98 
.94 
1.10 
.70 
.63 
.91 
.61 



.45 

.46 

.44 

.37 

.53 

.40 

.40 

.36 

.41 

.62 

.55 

.46 

.43 

.41 

.44 

.50 

.43 

.38 

.41 

.41 



(CO 
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Table 5 

Score Means and Standard Deviations for the Faired Comparison 
Form (Time 1) and Multiple Rank Order Form (Time 2), by Scale 



Mean 



Standard Deviation 



Scale 


Time 1 


Time 2 


Difference 


t° 


Time 1 

V 


Time 2 


Difference 


AU 


1.42 


1.45 


-.03 


.45 


h- — 

.59 


.63 


.49 


Ach 


1.61 


1.63 ■ 


- 02 


30 


.68 


.62 


.53 


Act 


20 


- 26 


06 


80 


80 


82 


.55 


Adv 


1 14 


1 01 


13 


9 19* 


82 


79 


.45 


Au 


- 41 


- 59 


1 8 

. XO 


9 83** 


80 


76 


.52 


CPP 


96 


72 


24 


L 57** 


58 


57 


.44 


C\r\rn 


58 


58 


00 


00 


90 


89 


.47 


Cow 


87 


77 


10 


1 85 


67 


.75 


• 46 


Cre 


98 


1 09 


11 

• X X 


1.76 


61 


74 


.48 


Ind 


-.31 


-.34 


03 


.44 


-.84 


• 87 


.59 


MV 


1 43 


1 38 


05 


53 


1 16 

X . X V 


1.40 


.72 


Rec 


87 


78 


09 


1 LCi 


80 


.79 


.51 


Reo 


.99 


.96 


.03 


.60 


.62 


.69 


.50 


Sec 


.56 


.57 


-.01 


.04 


.82 


.94 


.57 


SSe 


1.00 


.86 


.14 


2.21* 


.91 


:9i 


.53 


sst 


-.08 


-.16 


.08 


1.22 
3.06** 
1.51 \ 


1.11 


1.11 


.54 


SHR 


.50 


.31 


.19 


.68 


.60 


.51 


ST 


.43 


.35 


.08 


.65 


.67 


.45 


Var 


.17 


• .12 


.05 


1.03 


.73 


.65 


.46 


WC 


.84 


.85 


-.01 


.09 


.74 


.67 


.52 



Note . N - 67. 

"correlated t-test, df - 66. 

*E<.05. 
**2<.01. 
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Table 6 ^ 

Score Means and Standard Deviations for the Mulfciple Etank 
Order Form (Time 1) and Paired Comparison Form (Time 2), by Scale 



Mean Standard Deviation 



Scale 


Time 1 


Time 2 


Difference 




Time I 


Time 


Difference 


AU 


1.73 


L 

1.64 


..09 


1.57 


.51 


.52 


49 


Ach 


1.86 


1.64 


.22 


3.82** 


.63 


.54 


*-49 ^ 


Act 


. 33 - 


-.11 


.44 


7.13** 


.86 


.82 


.53 


Adv 


1.17 


- 1.14 


.03 


.50 


. .75 


.74 


.63 - 


Au 


-.31 


-:38 


.07 


.95 


.93 


.84 


.64 


GPP 


.67 


.85 


-.18 


3.27** 


.51 


.57 


.48 


Com 


.67 


.79 


" , -.12 


1.98 


.70 


.72 




Gow 


.85 


.77 


.08 


1.37 


.60 


.61 


.50 


Cre 


1.17 


1.03 


.14 


2.51* 


.58 


.64/ 


.49 


Ind 


-.06 


-•27 


* .21 


2.77* 


1.08 


.81 


.66 


MV 


1.11 


1.38 


-.27: 


3i.02** 


1.03 


1.22 


. 


Rec . 


.90 


• .79 


. .11 


1.68 


.89 


.88 


.56 


Res 


« 1.23 - 


.95 


. -.28 " 


.4.74** 


' .76 


:73' 


.51 


Sec 


1.02 


•-. ' r92 


.i(y, 


1.59 


.84 


.6? 


.54 


SSe 


1.05 - 


i.oa 


-.03 


. .33 ' . 


.94 


.91 


.67 , 


SSt 


.02' 


'-.24. 


.26 


3.46** 


1.06 


1.05 


.64 


SHR 


.40 


.40 


•,.00 


.02. 


.54 


' .61 


.56 


ST 


.21 . 


.20. 


'.01 


-.15 


' .73 


.61 


.47 


Var 


.47 


.26 


.21 


3.71** 


. .77 . 


.71 


»i .49 


WC 


.9.7 


-.79 


.18° 


3.03** 


.63 


.61 


.49 



^ No tie . N - 73. 

^Correlated t tett, df - 72. 

*g<.05. 
**B<.01. 
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, j Table 8 . 

Range and Mediati of) Profile Stability Coefficients, by Group 



Range 



Group* 


N 


Low 


High 




Medlaii 


PP 




.00* 


.99 




.92 


PR 


^ 67 


.66 


.98 




.91 


&P 


73 


.42 


.98 




.86 


RR 


/ 


.67 


.99 




.92 



a ^ 

.Abbreviation/ P » paired comparison and R « multiple rank order 



form of Minnesota Importance Questionnaire. 
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Table 9 

Frequencies, Percentages, and Chl*square Comparing 
Form Preference 9 by Order of Administration 



. Form Preference 



Order of 
Adminis tr at ion 



Paired 



Ranked 



Frequency 



Percent 



Freqaency 



Percent 



Paired -Ranked 
Ranked -Paired 



13 
33 



9.29 
23.57 



54 
40 



38.57 
28.57 



- 9.41, df " 1, E<.005. 
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Table 10 . 
Content Analysis of Reasons Given for PoA Preference 



Form t^eference 


Reason 


N 


^ " / ^ Multiple rank order 


Easier to rank five needs than to 
Judge between two needs because 
it allows^ for expression of degree 
or order of preference « 


54 




Faired comparison form is repet-, 
itive and boring. 


40 


^ Paired conparison 


Easier to Jtfdge between two needs 
than to rank five needs. 

> 


46 
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Table 11 

■.r1---- ' for"' 

Means, Standard Devlatlonfj, and Range Time Required to 
Complete the" Mthneaota Importance (hjeetionnalre, by Form 

FoTTQ Standard Devletion Raiigs 

Paired conparison (N - 140) 27' 52" 7' 34" 15' - 65' 

Multiple rank order (N - 138)« 16' 31" 6' 52" 8' - 31' 

Hote . Tlac in minutes. and aeconds. 

•Twelve aubjects did not report either beginning or completion time. 
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